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of the Form PTO-144 9. It is requested that the Examiner 
acknowledge consideration of the three "other" documents. If 
the Examiner's file for this application does not contain 
these documents, a call to the undersigned representative will 
result in prompt delivery of replacement copies. 

Initially, under cover of this Office Action, the 
Applicant submits a substitute specification. As evidenced by 
the companion marked-up specification, under cover of this 
substitute specification the Applicant now inserts the section 
headings normally found in United States patent applications 
and makes minor grammatical changes to the specification. The 
undersigned registered representative hereby states that none 
of the changes incorporated into the substitute specification 
introduce new matter into the substitute specification. 

At this time Applicant also amends Claims 20, 22-26 and 
29-34, New Claims 37-39 are added. No claims are cancelled. 
Claims 20, 29 and 37 are the independent claims of this 
application. Claims 21-28 remain dependent from Claim 20. 
Claims 30-36 remain dependent from Claim 29. Claims 38-39 
depend from Claim 37. 

Nagasawa merely discloses a method of modeling an object 
by "dividing a three dimensional surface to be displayed into 
a large number of unit surfaces."^ Each unit surface is 
represented by a normal vector that has rectangular 
coordinates x, y, z that represent the location of the unit 
surface, and azimuth angles 9, (p , that represent the orientation 
of the surface and a length A representative of the area of 
the unit surface. In the preferred representation of the unit 
surfaces, each surface is a disk.^ 

Nagasawa acknowledges that, if a polygon has a high 
aspect ratio or adjacent polygon values vary over a wide 
range, interpolation of surface data "becomes difficult" . 
Also, given that a disk "is largely different" from the 



^ U.S. Patent No. 6,061,065, colunm 2, lines 26-29, 

^ U.S. Patent No. 6,061,065, column 2, line 60 to column 3, line 8. 
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polygon it is meant to represent there is a resultant 
"degrading [in] surface quality." In order to minimize these 
problems, Nagasawa teaches one to divide the polygon into 
smaller polygons or assign disk values to each vertex of the 
polygon and interpolate between these disk values.*^ 

The above-described method of surface modeling a three- 
dimensional object on a two-dimensional plane does not equal 
Applicant's method of shading such an object as recited by 
Claim 20. Specifically, as recited by this claim, in the 
inventive method, first, data defining the image is provided, 
the image comprising a set of pixels. Then, a set of surface 
normal vectors that correspond to the texture data for the 
image are provided. As part of this step, an individual 
surface normal vector is assigned to each pixel. Data 
defining at least one light source and the direction in which 
it illuminates is also provided. Also, in the method of Claim 
20, for each pixel in the image, a shading value that is to be 
applied to the pixel is derived based on the surface normal 
vector assigned to the pixel and the light source data. 

Thus, the claimed method is simply not a substitute or 
variation for the method of surface modeling disclosed by 
Nagasawa- Instead, one could, first use Nagasawa' s method to 
define the basic characteristics of a polygon of a three- 
dimensional image. Then, the claimed method could be executed 
to provide supplemental texturing to the surface of the 
polygon. 

Therefore, Nagasawa does not suggest the method of 
texturing an image as defined by Applicant's Claim 20. 
Accordingly, it is respectfully submitted that this claim is 
directed to a nonobvious invention and is in condition for 
allowance . 

Claim 29 is directed to Applicant's apparatus for shading 
a computer graphic image . The claimed includes a means for 



^ U.S. Patent No. 6,061,065, column 6, lines 31-50. 
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providing data that defines the image, the data defining 
pixels that comprise the image. There is a means for 
providing a set of normal vectors that correspond to the 
texture data to be applied to the image and for assigning 
individual vectors to the pixels. 

The apparatus of Claim 29 also has a means for providing 
data that defines a light source and the direction of light 
emitted by the light source. The claimed apparatus also has a 
means for deriving a shading value that is applied to each 
pixel in the image based on the surface normal vector assigned 
to the pixel and the light source data. 

Just as Nagasawa does not suggest Applicant's method of / 
providing shading value for an image -forming pixel, it does 
not lead one to the apparatus of Claim 2 9 that performs this 
function. Therefore, this claim is likewise directed to an 
invention entitled to patent protection. 

New independent Claim 3 7 is directed to a method of 
shading a three-dimensional graphics textured image. In this 
method, a basic computer image to be textured is defined. 
This image comprises set of pixels. In this step, an existing 
color value for the pixel is determined. As part of this 
method, a determination is made regarding whether or not the 
basic computer image is to be subjected to supplemental 
shading . 

If the basic computer image is to be subjected to 
supplemental shading, a surface normal vector is provided. 
Data defining a light source and the direction from which the 
light source illuminates the basic computer image is provided. 
Then, based on the surface normal vector for the pixel and the 
data defining the light source and the direction from which 
the light source illuminates the image, an alpha value and a 
supplemental color value for the pixel are generated. The 
existing color value and the supplemental color value are then 
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blended together as function of the alpha value to produce a 
final color value for the pixel . 

However, in the method of Claim 37, if the basic computer 
image is not to be subjected to supplemental shading, the 
existing color value is designated as the final color value. 

As discussed above, Nagasawa is merely directed to a 
method of geometrically locating polygon sections of a three- 
dimensional image. It does not describer how one shades a 
particular section. Therefore, this document does not suggest 
anything relevant to Applicant's method as recited by Claim 37 
which is directed to method for determining whether or not an 
image is to be subjected to supplemental shading that 
identifies the steps that are executed to perform the shading. 

Claim 37 is thus likewise directed to an invention that 
is a non-obvious departure from the prior art 

The earliest priority date of Shirman is 22 August 1997. 
This date is after the 20 August 1997 filing date of British 
Application, App UK No. 9717656.4, the application from which 
the present application claims priority. The Form 
PCT/DO/EO/903 , mailed by the Patent and Trademark Office for 
this application on 24 May 2000, states that the Office 
already has in its possession a certified copy of the '656.4 
Application, Per 35 U.S.C. 119 and 37 CFR Sec. 1.55, the 
Applicant is entitled to claim as a priority filing date the 
20 August 1997 filing date of the '656.4 Application. Since 
this date is before the earliest potential filing date for 
Shirman, Shirman should now be withdrawn as a reference 
against the present application. 

Gholizadeh is directed to a method of normalizing 
vectors. Like the above discussed documents, this document 
does not teach anything relevant to Applicant's claimed method 
and apparatus for surface shading. 

The dependent claims are all allowable at least because 
they depend from allowable independent claims. 
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In sum, the Applicant submits that all of the claims of 
this application, as well as the other parts of the 
application, are in an allowable form. Accordingly, the 
Applicant now respectfully solicits prompt issuance of a 
Notice of Allowance. 

Respectfully submitted, 



David S . Goldenberg 
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SHADING THREE DIMENSIONAL COMPUTER GRAPHICS IMAGES 
FIELD OF THE INVENTION 
This invention relates to the shading of three dimensional 
computer graphic images, and especially to graphic images 
generated in real time. 

BACKGROUND OF THE INVENTION 
Many three dimensional computer graphics images are modelled with 
perfectly flat or smooth surfaces. Usually these surfaces are 
constructed from a plurality of small triangles to which is 
applied either flat shading, or smooth shading as described in 
"Transactions on Computers" IEEE-20 (6) June 1971 pp 623 to 629 by 
Gouraud, H., graduated shading, or, less frequently Phong shading 
from CACM 18 (6) June 1975 pp 311 to 317 "Illumination for Computer 
Generated Pictures" . Visual detail may be applied to these 
surfaces via the application of textures. These textures are 
generally two dimensional images and the process is similar to 
having an image painted onto a perfectly smooth wall. It does not 
model any surface roughness or any shading effects which might 
arise therefrom. 

In computer graphics the way in which light interacts with the 
surface is referred to as shading. One of the simpler models used 
for shading is known as Lambert or diffuse shading. It is computed 
as a function of the direction of the light illuminating the 
surface and the orientation of that surface. The orientation is 
represented by a unit vector perpendicular to the surface (a 
surface normal) . The light direction is also preferably assumed 
to be a unit vector which points from the surface to the point of 
illumination. In the case of flat shading the surface nojrmal is 
considered to be constant across the entire surface. With Gouraud 
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shading three surface normals defined at the vertices of each 
triangle are used. The shading at the vertices of the triangles is 
calculated from these normals. These shading values are then 
interpolated across the entire surface. This is a satisfactory 
approximation in many cases. However, it does lead to shading 
problems such as mach banding and problems with specular 
highlights . 

Phong shading gives a superior result to this because it 
interpolates the surface normally across the triangle and then 
recalculates the shading at each pixel. However, both of these per 
pixel operations are considered to be relatively expensive 
computationally and, therefore, Gouraud shading is therefore more 
commonly used. 

3D computer graphics often makes use of specular shading in 
addition to diffuse lighting. Specular shading is the modelling of 
glossy rcfcctiono reflect ions of lights. In both types of shading a 
common basis for the calculation of the shading to be applied is a 
vector dot product raised to a power. This is shown in equation 1 



In "simulation of wrinkled surfaces" by Blinn, J.F. in Siggaph 
1978 pp 286 to 292 there is proposed the concept of bump mapping. 
This uses an adaptation of texturing to deviate surfaces normal on 
a pixel by pixel basis. The texture data used to form the 
derivation of the normal is referred to as the bump map. 



below. 




Although the position of the surface is not actually moved in 3D 
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graphic space it appears rough because shading is performed with a 
surface normal which moves in direction as the surface is 
traversed. 

This process is known as surface normal perturbation. What is 
stored in the bump map is an amount by which the surface normal is 
to deviate from its previous value. Thus, in order to compute the 
shading applied to a surface it is necessary to retrieve data 
about the deviation of the surface normal from the bump map prior 
to applying this deviation to the surface normal . The surface 
normal then has to be renormalised in dependence on the 
orientation of the surface to which it is applied- The shading 
calculation is then performed. 

The effect of this leads to realistic dynamic changes in shading 
as a light source moves relative to the surface. However, 
computationally the scheme is approximately the same as that of 
Phong shading and so to date has been restricted to non-real time 
applications. 

SUMMARY OF THE INVENTION 
We have appreciated that an effect similar to that proposed by 
Blinn can be implemented with much less computational power thus 
enabling realistic changes of shading to be implemented in real 
time . 

Preferably this is implemented in addition to the usual 3D 
computer graphics rendering systems which are in common usage for 
texturing and shading. 

Preferably, after a surface has been rendered^ the bump map 
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effects are applied as an additional pass over the surface. For 
each image element or pixelj_ a bump map texture element is 
obtained in a way identical to the usual texturing operation. 
Lighting values are also interpolated across the surface on a 
pixel by pixel basis from the light sources in use. The lighting 
values for a particular pixel are combined with the bump map texel 
(texture element) to produce an alpha value and a colour and 
thereby look identical to the usual output of the texturing 
engine. These are then supplied to the usual blending units to 
apply the texture. Unlike the approach taken by Blinn^ each texel 
of the bump map stores the actual direction of the surface normal 
after perturbation rather than the displacements of the surface 
normal. These normals are given in the surface's coordinate 
system which is preferably the polar coordinate system. Lighting 
values are similarly expressed in terms relative to the surface's 
coordinate system. 

The invention is defined with more precision in the appended 
claims to which reference should now be made. 

BRIEF DESCRIPTION OF THE DRAWINGS 
A preferred embodiment of the invention will now be described in 
detail by way of example with reference to the accompanying 
drawings in which: 

Figure 1 is a block diagram of circuitry a first embodiment of the 
inventions- 
Figure 2 is a schematic diagram showing the surface normal and its 
coordinate system; and 
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Figure 3 is a block diagram of the bump map hardware of Figure 1. 

Figure 4 is a schematic diagram showing the surface normal and a 
Cartesian coordinate representation system in contrast with the 
polar coordinates of f igurc Figure 2; 

Figure 5 shows schematically a linear filter applied to texels-r^ 

DETAILED DESCRIPTIONT 
As described above this invention relates to computer 3D graphics 
rendering systems and is applicable but not restricted to hardware 
based rendering systems. A hardware based system is described here 
by way of example. 

The first embodiment of the invention shown in Figure 1 comprises 
a modified conventional 3D rendering system. Conventional 3D 
texture hardware 2 is used to apply texture to the image and 
rending hardware 4 then shades the textured image. Conventionally 
a single connection is provided between these two hardware blocks. 

In the modified system of Figure 1 a store 6 is used for surface 
bump map direction parameters for a number of different bump maps. 
This stores a set of surface normals pointing in different 
directions in dependence on their location in the bump map. These 
are called up by the bump map hardware 8 which combines the 
lighting values for a particular pixel with the bump map data from 
the store 6 to produce an alpha value and a colour. These are 
identical to the usual output of the 3D texture hardware 2 and are 
then supplied to the usual blending unit which uses the alpha 
value to combine the colour with existing colour at that pixel in 
proportions dependent on the alpha value (alpha is between 0 
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and 1) . 

Thus, the system applies surface normal perturbation effects to a 
surface as one additional single pass to modify the existing 
texturing and shading. When it is determined thatj_ for a given 
surface and picture element "pixel" that a bump map pass is 
required, then the appropriate surface parameters are obtained for 
that surface. The surface normal for that pixel is determined by 
accessing the bump map texture associated with the surface in a 
similar manner to existing texture mapping methods. A direction 
parameter is also calculated for the pixel by interpolation. This 
is similar to the RGB interpolation performed for Gouraud shading. 
Thus the alpha value and colour value are supplied to the blending 
unit . 

The bump map surface normals stored in store 6 are encoded in 
polar coordinate as shown in Figure 2 . Angle S represents the 
elevation of the surface normal and goes from 0 to 90*^. Angle R 
is the rotation of the surface normal and goes from 0 to 360°. As 
the surface normal is a unit vectorj_ the length value is always 
^1 , and so it is not required to store this. Thus a saving on 
memory is achieved. 

In one embodiment of the invention^ the per surface direction 
parameters for the lighting sources are also encoded in spherical 
coordinates with parameters T ranging from 0 to 90 and Q ranging 
from 0 to 360°. The dot product power function of equation 1 
would then be implGmontatGd implemented as shown below in equation 
2 . 

((l-/z) + /2(sin(5)sin(r) + cos(5')cos(r)cos(i?-e)))'^ 



6 



# 



U. S. Serial No. 09/486 012 February 28, 2003 

Marked-Up Version of Specification 

The parameter ah is a weighting value that lies in the range 0 to 
1. The surface direction parameters T and Q can be interpolated 
in a manner similar to that used in Gouraud shading. 

Another embodiment would include the T and H per surface direction 
parameters as parameters ki, k2/ ka thus giving the dot product 
power function shown below in equation 3 . 

(/:. + A:2 sin (5) + A:3 cos (^S*) cos {R - Q)f 

Typically these values would be calculated as shown below in 
equation 4. 

k^ = {\-h)\ k2 = hsm{T); k. = hcos{T); 

This gives further flexibility as well as reducing the complexity 
of the implementation in hardware. 

An embodiment of the invention using the equation shown in 
equation 3 is illustrated in Figure 3 . 

The elevation angle S for the surface normal is first passed to a 
sine and cosine unit 10 which computes the sine and cosine of the 
elevation and applies these to multipliers 12 and 14 where they 
are combined with lighting parameters k2 and ka . At the same time, 
the rotation angle R of the surface normal has the rotation angle 
Q of the lighting value subtracted from it in subtracter 16. The 
cosine of this angle is then derived in cosine unit 18. The output 
of this unit is unsigned and is fed to a multiplier 20 where it 
serves to multiply the output of multiplier 14. The output of 
multiplier 12 is then passed to an adder 22 where it is added to 
lighting parameter ki . 

/ 



7 



U. S. Serial No. 09/486 012 
Marked-Up Version of Specification 



February 28, 2003 



The output of adder 22 and multiplier 20 are then passed to an 
add/subtract unit 24. A signed bit 26 supplied by the cosine unit 
18 determines whether the addcr if add/subtract unit 24 adds or 
subtracts the output of multiplier 20 from the output of adder 22. 

The output of this addcr add/ subtract unit 24 is a signed 11 bit 
number which is supplied to a clamping unit 2 8 which reduces it to 
the range 0 to 255 (8 bits) and outputs this to a power unit 3 0 
which raises its value to a power p which is supplied to the 
powcr blend unit. 

In this embodimentj_ the S and R values obtained from the bump map 
texture are both encoded as 8 bit unsigned numbers. For S 0 to 255 
represents angles of 0 to almost 90° (256 would represent 90° 
exactly) while for R 0 to 255 represents angles of 0 to almost 
360° (256 would represent 360° exactly) . 

The units of Figure 3 show the number of bits and whether or not 
those integers are signed or unsigned. U x Ux represents an unsignec 
X bit integer. While S—^S^ represents a signed x bit integer. 

Thus, the alpha output to the blending unit is provided along with 
a colour from the existing 3D texture hardware 2. The existing 
colour and the new colour are then combined in the blending 
hardware 4 to produce a new value for that particular pixel. 

Using thd.s method has several advantages. Firstly, storage of 
surface noirmals as polar co-ordinates makes the bump map data 
compact compared to the method of Blinn which used surface normal 
displacements. Furthermore, renormalisation of the surface normals 
is not necessary because of the nature of storage as surface 
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normals- Finally, interpolation of light direction is a 
relatively straight forward calculation to be performed since in 
most scenes there will only be a small number of light sources on 
which the lighting direction has to be based. This enables 
rendering to be performed in real time. 

The bump mapping technique described above has some shortcomings . 
These are: 

1. Interpolation of the lighting direction given at each vertex is 
"tricky" as the direction is specified in polar coordinates. 
Although polar coordinates allow greater precision with the 
direction specification and do not need normalisation, to perform 
the interpolation requires significant modification to the 
iterator units. Because of this, the hardware can assume that the 
light direction is constant across each polygon. This effectively 
eliminates Phong shading. 

2. For similar reason, bilinear texturing computations are more 
complicated. Although some modifications were made to perform 
angular bilinear, the actual results are not ideal. 

3. The system cannot model light directions that are 'below' the 
horizon - these must be converted to an approximate direction that 
is on the horizon, 

4. The software interface bears little resemblance to the actual 
hardware interface. This means extra work for the drivers or at 
least to the application. 

The second embodiment described below addresses these issues. To 
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do this there are two major changes to the implementation: 

1. The light direction vector is now specified in "X,Y,Z" fixed 
point coordinates. This is very similar to a typical software 
interface, in which the light direction vector is given in 
floating point coordinates. Ideally, the floating point vector 
will have been normalised. 

2 . The bump map texel directions are also now specified in 
Cartesian coordinates, except that one component can be eliminated 
due to redundancy. We thus only store "X" and "Z" per texel. 

The idea of specifying bumps and light directions in a local 
vertex coordinate system remains the same. Converting a height 
map to the new format is much easier than the old, since no 
trigonometry is required. 

Additionally, the new technique includes a 'glossiness' parameter 
that allows the modelling of specular highlights. 

As in the first embodimentj_ each texel stores the 'angle' or 
'surface normal' of the bumpy surface at that particular texel, 
and it is assumed that the vector can lie anywhere within a 
hemisphere, as shown in f igurc Figure 4. 

We are not interested in the length of this vector (as it is 
assumed to be of unit length) but only in its angle. In the first 
embodiment, this vector was stored using polar coordinates, 
however these are a nuisance to interpolate. 

In the second embodiment, the vector is represented in the more 
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usual Cartesian coordinate system. The obvious way to store this 
would be X,Y,Z, where Y is always positive, and X & Z are signed 
values, however, we are typically limited to only 16 bits. If, 
however, we scale the vector such that 



Xs\ + J^. + 



= 1 



then there is no need to store the Y component at all, since it 
can be derived from the other two values. Note that this vector is 
no longer of unit length. Also all components of this vector are 

-^^4-<l and that the length of this scaled vector is also -^^<1 . 

Expressing this in terms of a 16 bit texel, we would have the 
following : 

UNIT 8 TexelX, TexelY; 

TexelX=((int) (Xscaled * 127.0f))-fl27; 
TexelZ=((int) (Zscaled * 127.0f))=127; 

This packs X and Z as offset 8 bit values. That is, a value of 0 

represents ~^^J^27 ' ^^^-'-^ represents "*"^^y^27 * this 

notation rather than the usual 2's complement to make the bilinear 
interpolat ion straight - forward . 

To extract the X,Y and Z components ^ in the hardware', we do... 
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INT9 BumpX, BumpZ; 
UINT8 BumpY; 

BumpX = (TexelX - 127)*2; 

BumpZ = (TexelZ - 127)*2; 

BumpY = 255 - ABS(BumpX) - ABS(BumpZ); 

We are guaranteed that Y is positive as 

(ABS (BumpX) -\-ABS{BumpZ))must be < 255. {ABS{BumpX) \ ABS{BumpZ)) must be (-255 

(The above could probably be expressed better) . 
TexelX and TexelZ can be the results from the 
linear/bilinear/tri linear filtering. 

One of the problems with the first embodiment is the behaviour of 
the bilinear filtering. With angles, there is a problem with 
wrapping around or taking the shortest interpolation path. This is 
eliminated with the X/Z scheme. 

The interpolation is performed with just the TexelX and TexelZ 
components, and the Y is calculated from the filtered result. 
Since these values are in the range 0 . . 255 0 to 255 , the standard 
RGB filtering hardware is directly applicable. For the following 
examples, only a linear 'filter' will be used since both bilinear 
and trilinear are repeated linears. 

Figure 5 shows a view from above looking down on the bump 
direction hemisphere. The dotted diamond shape represents the 
limits of the scaled X and Z values, which when renormalised with 
the computed Y value would stretch out to the boundary of the 
hemisphere- Three example linear interpolations in X and Z are 
shown . 
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For Path A, the interpolation would result in an angle that goes 
up and over the pole of the hemisphere - which is ideal. The 
previous method would have chosen a path that ran in a circle 
'copying' the circumference. For Path B, the interpolation would 
stay close to the circumference of the hemisphere. Path C, should 
also result in a sensible interpolation with a rise and fall in 
the *Y' component. 

The only likely quibble with this scheme is that the rate of 
change of the angle may not be constant, but this seems very 
minor . 

To prevent loss of accuracy with fixed point implementations, it 
is important that the length of the vector should not decrease too 
greatly, since in a fixed point system, bits will be lost. In this 
encoding , the minimum length would occur when 

= = = , resulting in a length of J/^ • This loses less than 
2 bits of accuracy, and so is acceptable. 

There are two things we must guard against. The first is that not 
all possible combinations of ' texel ' contents are valid. Since we 

have specified that |x| + + [zs] = 1 a texel that has |x5| + |z,|^l is 

clearly invalid. We must therefore, protect against such 
occurrences . 

The second point is that even if the original texels are valid, 
there is a small chance that the bilinear unit will produce X and 
Z values which also just exceed these legal values. 

As with the alternate bump format the light direction vector is 
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stored in Cartesian coordinates. The only space we have available 
is the Of f setRGB/original-BumpK values, as an example we may have 
8 bits for each of the X, Y, and Z components. These values all 
need to be signed, and to keep accuracy, it is assumed that the 
light direction vector is normalised before conversion to integer , 
The per- vertex values would therefore be calculated from. . . 
int8 VertX, VertY, VertZ; 

VertLightX = ((int) (LightDir(0)*127.0f))&0xFF; 
VertLightY = ((int) (LightDir(l)*127.0f))&0xFF; 
VertLightZ = ((int) (LightDir(2)*127.0f))&0xFF; 

Since we are assuming that each vertex light vector is of unit 
length and because we are using 'linear' interpolation, the vector 
for a particular pixel will have a length that is -(^4- <l . As with 
the bump map, it is important that the in-between vectors are not 
too short or else too much accuracy will be lost. 

If we assume that the maximum sensible angle difference will be 

120° then the shortest vector will be sin(30*^) - . We will 

therefore only lose about 1 bit of accuracy due to the shortening 
of vectors . 

To have the chance of 'smooth' animation, it is important that 
small changes in light direction can be modelled. This will be 
of maximum importance near where the light direction = (0,1,0) ie . 
on the horizon so examining the minimum integer variation that 
seems possible we get [2,254,0]. This appears to be about an angle 
of 0,1 degrees, which seems small enough. 

The shading "dot product" computation is much simpler than it is 
with polar coordinates and is implemented in a well known manner. 
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To simulate glossy highlights, a * power* function is usually 
applied to the dot product so that bright areas become 
concentrated. The typical Phong lighting model raises the dot 
product to an arbitrary power, but this is too expensive to 
implement in hardware. 

A cheaper, but more than satisfactory function is to use a 
quadratic approximation as shown below. 
Let X be the result of the dot product, 

C be a 'fixed point' 8 bit concentration value, where C=0 (==0.0) 
gives a linear output, and C=255 (==1.0) gives maximum 
concentration . 

We compute . . . 

• k — C -\-Sl (k is a 9 bit value with 3 bits of fraction) 

• L= MAX(0, 1 023 -(/:*(! 023 - ) » 3)); Lisa W bit fractional value 

• Q = {L'*^ L)^\0 Q is a 10 bit fractional value 

• P = Z + C*(e-Z)»8; 

P is then the fixed point result of the power function. Note that 
Q<L and so the final calculation will require signed maths. 

In total, the highlight function will require 5 add/ subtracts and 
3 multiplies, although a couple of these are rather simple 
degenerate cases . 

Thus, it will be appreciated that preferred embodiments of the 
present invention provide a system which enables textured surfaces 
to be shaded much more efficiently than has been possible. 
What is claimed is: 
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SHADING THREE DIMENSIONAL COMPUTER GRAPHICS IMAGES 
FIELD OF THE INVENTION 
This invention relates to the shading of three dimensional 
computer graphic images, and especially to graphic images 
generated in real time. 

BACKGROUND OF THE INVENTION 
Many three dimensional computer graphics images are modelled 
with perfectly flat or smooth surfaces. Usually these surfaces 
are constructed from a plurality of small triangles to which 
is applied either flat shading, or smooth shading as described 
in "Transactions on Computers" IEEE-2 0 (6) June 1971 pp 623 to 
629 by Gouraud, H., graduated shading, or, less frequently 
Phong shading from CACM 18 (6) June 1975 pp 311 to 317 
"Illumination for Computer Generated Pictures". Visual detail 
may be applied to these surfaces via the application of 
textures. These textures are generally two dimensional images 
and the process is similar to having an image painted onto a 
perfectly smooth wall. It does not model any surface roughness 
or any shading effects which might arise therefrom. 

In computer graphics the way in which light interacts with the 
surface is referred to as shading. One of the simpler models 
used for shading is known as Lambert or diffuse shading. It is 
computed as a function of the direction of the light 
illuminating the surface and the orientation of that surface. 
The orientation is represented by a unit vector perpendicular 
to the surface (a surface normal) . The light direction is 
also preferably assumed to be a unit vector which points from 
the surface to the point of illumination. In the case of flat 
shading the surface normal is considered to be constant across 
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the entire surface. With Gouraud shading three surface normals 
defined at the vertices of each triangle are used. The shading 
at the vertices of the triangles is calculated from these 
normals. These shading values are then interpolated across the 
entire surface. This is a satisfactory approximation in many 
cases. However, it does lead to shading problems such as mach 
banding and problems with specular highlights. 

Phong shading gives a superior result to this because it 
interpolates the surface normally across the triangle and then 
recalculates the shading at each pixel. However, both of these 
per pixel operations are considered to be relatively expensive 
computationally and, therefore, Gouraud shading is therefore 
more commonly used. 

3D computer graphics often makes use of specular shading in 
addition to diffuse lighting. Specular shading is the 
modelling of glossy reflections of lights. In both types of 
shading a common basis for the calculation of the shading to 
be applied is a vector dot product raised to a power. This is 
shown in equation 1 below. 



In "simulation of wrinkled surfaces" by Blinn, J.F. in Siggaph 
1978 pp 2 86 to 2 92 there is proposed the concept of bump 
mapping. This uses an adaptation of texturing to deviate 
surfaces normal on a pixel by pixel basis. The texture data 
used to form the derivation of the normal is referred to as 
the bump map . 
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Although the position of the surface is not actually moved in 
3D graphic space it appears rough because shading is performed 
with a surface normal which moves in direction as the surface 
is traversed. 

This process is known as surface normal perturbation. What 
is stored in the bump map is an amount by which the surface 
normal is to deviate from its previous value. Thus, in order 
to compute the shading applied to a surface it is necessary to 
retrieve data about the deviation of the surface normal from 
the bump map prior to applying this deviation to the surface 
normal. The surface normal then has to be renormalised in 
dependence on the orientation of the surface to which it is 
applied. The shading calculation is then performed. 

The effect of this leads to realistic dynamic changes in 
shading as a light source moves relative to the surface. 
However, computationally the scheme is approximately the same 
as that of Phong shading and so to date has been restricted to 
non-real time applications. 

SUMMARY OF THE INVENTION 
We have appreciated that an effect similar to that proposed by 
Blinn can be implemented with much less computational power 
thus enabling realistic changes of shading to be implemented 
in real time. 

Preferably this is implemented in addition to the usual 3D 
computer graphics rendering systems which are in common usage 
for texturing and shading. 
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Preferably, after a surface has been rendered, the bump map 
effects are applied as an additional pass over the surface. 
For each image element or pixel, a bump map texture element is 
obtained in a way identical to the usual texturing operation. 
Lighting values are also interpolated across the surface on a 
pixel by pixel basis from the light sources in use. The 
lighting values for a particular pixel are combined with the 
bump map texel (texture element) to produce an alpha value and 
a colour and thereby look identical to the usual output of the 
texturing engine. These are then supplied to the usual 
blending units to apply the texture. Unlike the approach taken 
by Blinn, each texel of the bump map stores the actual 
direction of the surface normal after perturbation rather than 
the displacements of the surface normal. These normals are 
given in the surf ace * s coordinate system which is preferably 
the polar coordinate system. Lighting values are similarly 
expressed in terms relative to the surface's coordinate 
system. 

The invention is defined with more precision in the appended 
claims to which reference should now be made. 

BRIEF DESCRIPTION OF THE DRAWINGS 
A preferred embodiment of the invention will now be described 
in detail by way of example with reference to the accompanying 
drawings in which: 

Figure 1 is a block diagram of circuitry a first embodiment of 
the invention; 

Figure 2 is a schematic diagram showing the surface normal and 
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its coordinate system; and 

Figure 3 is a block diagram of the bump map hardware of Figure 
1. 

Figure 4 is a schematic diagram showing the surface normal and 
a Cartesian coordinate representation system in contrast with 
the polar coordinates of Figure 2 ; 

Figure 5 shows schematically a linear filter applied to 
texels . 

DETAILED DESCRIPTION 
As described above this invention relates to computer 3D 
graphics rendering systems and is applicable but not 
restricted to hardware based rendering systems. A hardware 
based system is described here by way of example. 

The first embodiment of the invention shown in Figure 1 
comprises a modified conventional 3D rendering system. 
Conventional 3D texture hardware 2 is used to apply texture to 
the image and rending hardware 4 then shades the textured 
image. Conventionally a single connection is provided between 
these two hardware blocks . 

In the system of Figure 1 a store 6 is used for surface bump 
map direction parameters for a number of different bump maps. 
This stores a set of surface normals pointing in different 
directions in dependence on their location in the bump map. 
These are called up by the bump map hardware 8 which combines 
the lighting values for a particular pixel with the bump map 
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data from the store 6 to produce an alpha value and a colour. 
These are identical to the usual output of the 3D texture 
hardware 2 and are then supplied to the usual blending unit 
which uses the alpha value to combine the colour with existing 
colour at that pixel in proportions dependent on the alpha 
value (alpha is between 0 and 1) . 

Thus, the system applies surface normal perturbation effects 
to a surface as one additional single pass to modify the 
existing texturing and shading. When it is determined that, 
for a given surface and picture element "pixel" that a bump 
map pass is required, then the appropriate surface parameters 
are obtained for that surface. The surface normal for that 
pixel is determined by accessing the bump map texture 
associated with the surface in a similar manner to existing 
texture mapping methods. A direction parameter is also 
calculated for the pixel by interpolation. This is similar to 
the RGB interpolation performed for Gouraud shading. Thus the 
alpha value and colour value are supplied to the blending 
unit . 

The bump map surface normals stored in store 6 are encoded in 
polar coordinate as shown in Figure 2 . Angle S represents the 
elevation of the surface normal and goes from 0 to 90°. Angle 
R is the rotation of the surface normal and goes from 0 to 
360°. As the surface normal is a unit vector, the length 
value is always 1, and so it is not required to store this. 
Thus a saving on memory is achieved. 

In one embodiment of the invention, the per surface direction 
parameters for the lighting sources are also encoded in 
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spherical coordinates with parameters T ranging from 0 to 90° 
and Q ranging from 0 to 360°. The dot product power function 
of equation 1 would then be implemented as shown below in 
equation 2. 

((1 - /z) + (sin (5) sin (r) + cos (5) cos (T) cos {R - Q))y 

The parameter h is a weighting value that lies in the range 0 
to 1. The surface direction parameters T and Q can be 
interpolated in a manner similar to that used in Gouraud 
shading . 

Another embodiment would include the T and H per surface 
direction parameters as parameters ki, k2, thus giving the 
dot product power function shown below in equation 3. 

{k^-\-k2sm{S) + k3 COS (5) COS {R - Q)f 

Typically these values would be calculated as shown below in 
equation 4 . 

kx = {l-h)\ k2 = hsm{T); k3 = hcos{T); 

This gives further flexibility as well as reducing the 
complexity of the implementation in hardware. 

An embodiment of the invention using the equation shown in 
equation 3 is illustrated in Figure 3 . 

The elevation angle S for the surface normal is first passed 
to a sine and cosine unit 10 which computes the sine and 
cosine of the elevation and applies these to multipliers 12 
and 14 where they are combined with lighting parameters k2 and 
k3 . At the same time, the rotation angle R of the surface 



7 



U. S. Serial No. 09/486 012 February 28, 2003 

Substitute Specification 

normal has the rotation angle Q of the lighting value 
subtracted from it in subtracter 16. The cosine of this angle 
is then derived in cosine unit 18. The output of this unit is 
unsigned and is fed to a multiplier 20 where it serves to 
multiply the output of multiplier 14. The output of multiplier 
12 is then passed to an adder 22 where it is added to lighting 
parameter ki . 

The output of adder 22 and multiplier 20 are then passed to an 
add/subtract unit 24. A signed bit 26 supplied by the cosine 
unit 18 determines if add/subtract unit 24 adds or subtracts 
the output of multiplier 20 from the output of adder 22. 

The output of add/subtract unit 24 is a signed 11 bit number 
which is supplied to a clamping unit 28 which reduces it to 
the range 0 to 255 (8 bits) and outputs this to a power unit 
3 0 which raises its value to a power p which is supplied to 
the blend unit . 

In this embodiment, the S and R values obtained from the bump 
map texture are both encoded as 8 bit unsigned numbers. For S 
0 to 255 represents angles of 0 to almost 90^ (256 would 
represent 90° exactly) while for R 0 to 255 represents angles 
of 0 to almost 360° (256 would represent 360° exactly) . 

The units of Figure 3 show the number of bits and whether or 
not those integers are signed or unsigned. Ux represents an 
unsigned x bit integer. While Sx represents a signed x bit 
integer . 

Thus, the alpha output to the blending unit is provided along 
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with a colour from the existing 3D texture hardware 2 . The 
existing colour and the new colour are then combined in the 
blending hardware 4 to produce a new value for that particular 
pixel . 

Using this method has several advantages. Firstly, storage of 
surface normals as polar co-ordinates makes the bump map data 
compact compared to the method of Blinn which used surface 
normal displacements. Furthermore, renormalisation of the 
surface normals is not necessary because of the nature of 
storage as surface normals. Finally, interpolation of light 
direction is a relatively straight forward calculation to be 
performed since in most scenes there will only be a small 
number of light sources on which the lighting direction has to 
be based. This enables rendering to be performed in real time. 

The bump mapping technique described above has some 
shortcomings . These are : 

1. Interpolation of the lighting direction given at each 
vertex is "tricky" as the direction is specified in polar 
coordinates. Although polar coordinates allow greater 
precision with the direction specification and do not need 
normalisation, to perform the interpolation requires 
significant modification to the iterator units. Because of 
this, the hardware can assume that the light direction is 
constant across each polygon. This effectively eliminates 
Phong shading . 

2. For similar reason, bilinear texturing computations are 
more complicated. Although some modifications were made to 
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perform angular bilinear, the actual results are not ideal. 

3. The system cannot model light directions that are 'below' 
the horizon - these must be converted to an approximate 
direction that is on the horizon. 

4 . The software interface bears little resemblance to the 
actual hardware interface. This means extra work for the 
drivers or at least to the application. 

The second embodiment described below addresses these issues. 
To do this there are two major changes to the implementation: 

1. The light direction vector is now specified in "X,Y,Z" 
fixed point coordinates. This is very similar to a typical 
software interface, in which the light direction vector is 
given in floating point coordinates. Ideally, the floating 
point vector will have been normalised. 

2. The bump map texel directions are also now specified in 
Cartesian coordinates, except that one component can be 
eliminated due to redundancy. We thus only store "X" and "Z" 
per texel . 

The idea of specifying bumps and light directions in a local 
vertex coordinate system remains the same. Converting a 
height map to the new format is much easier than the old, 
since no trigonometry is required. 

Additionally, the new technique includes a 'glossiness' 
parameter that allows the modelling of specular highlights. 
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As in the first embodiment, each texel stores the 'angle' or 
'surface normal* of the bumpy surface at that particular 
texel, and it is assumed that the vector can lie anywhere 
within a hemisphere, as shown in Figure 4. 

We are not interested in the length of this vector (as it is 
assumed to be of unit length) only in its angle. In the first 
embodiment, this vector was stored using polar coordinates, 
however these are a nuisance to interpolate. 



In the second embodiment, the vector is represented in the 
more usual Cartesian coordinate system. The obvious way to 
store this would be X,Y,Z, where Y is always positive, and X & 
Z are signed values, however, we are typically limited to only 
16 bits. If, however, we scale the vector such that 



+ ys + 



= 1 



then there is no need to store the Y component at all, since 
it can be derived from the other two values. Note that this 
vector is no longer of unit length. Also all components of 
this vector are <1 and that the length of this scaled vector 
is also <1 . 



Expressing this in terms of a 16 bit texel, we would have the 
following: 



UNITS TexelX, TexelY; 

TexelX=((int) (Xscaled * 127.0f))+127; 
TexelZ=((int) (Zscaled * 127.00)=127; 
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This packs X and Z as offset 8 bit values. That is, a value of 
0 represents ~^^/^27 ' while 254 represents '*"^^/^27 ' 
this notation rather than the usual 2's complement to make the 
bilinear interpolation straight -forward . 

To extract the X,Y and Z components 'in the hardware', we 
do. . . 

INT9 BumpX, BumpZ; 
UINT8 BumpY; 

BumpX = (TexelX - 127)*2; 

BumpZ = (TexelZ - 127)*2; 

BumpY = 255 - ABS(BumpX) - ABS(BumpZ); 

We are guaranteed that Y is positive as 

[ABS {BumpX) -\-ABS{BumpZ))must be < 255. 

(The above could probably be expressed better) . 
TexelX and TexelZ can be the results from the 
linear/bilinear/trilinear filtering . 

One of the problems with the first embodiment is the behaviour 
of the bilinear filtering. With angles, there is a problem 
with wrapping around or taking the shortest interpolation 
path. This is eliminated with the X/Z scheme. 

The interpolation is performed with just the TexelX and TexelZ 
components, and the Y is calculated from the filtered result. 
Since these values are in the range 0 to 255, the standard RGB 
filtering hardware is directly applicable. For the following 
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examples, only a linear 'filter' will be used since both 
bilinear and trilinear are repeated linears. 

Figure 5 shows a view from above looking down on the bump 
direction hemisphere. The dotted diamond shape represents the 
limits of the scaled X and Z values, which when renormalised 
with the computed Y value would stretch out to the boundary of 
the hemisphere. Three example linear interpolations in X and Z 
are shown . 

For Path A, the interpolation would result in an angle that 
goes up and over the pole of the hemisphere - which is ideal. 
The previous method would have chosen a path that ran in a 
circle 'copying' the circumference. For Path JB, the 
interpolation would stay close to the circumference of the 
hemisphere. Path C, should also result in a sensible 
interpolation with a rise and fall in the 'Y' component. 
The only likely quibble with this scheme is that the rate of 
change of the angle may not be constant, but this seems very 
minor. 

To prevent loss of accuracy with fixed point implementations, 
it is important that the length of the vector should not 
decrease too greatly, since in a fixed point system, bits will 
be lost. In this encoding , the minimum length would occur 



when 




length of 




This loses 



less than 2 bits of accuracy, and so is acceptable. 



There are two things we must guard against. The first is that 
not all possible combinations of ' texel ' contents are valid. 
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Since we have specified that |x| + J^j +|z*| — 1 a texel that has 

|x| + |zj|>-1 is clearly invalid. We must therefore, protect 
against such occurrences . 

The second point is that even if the original texels are 
valid, there is a small chance that the bilinear unit will 
produce X and Z values which also just exceed these legal 
values . 

As with the alternate bump format the light direction vector 
is stored in Cartesian coordinates. The only space we have 
available is the Of f setRGB/original-BumpK values, as an 
example we may have 8 bits for each of the X, Y, and Z 
components. These values all need to be signed, and to keep 
accuracy, it is assumed that the light direction vector is 
normalised before conversion to integer. The per-vertex values 
would therefore be calculated from. . . 
int8 VertX, VertY, VertZ; 

VertLightX = ((int) (LightDir(0)*127.0f))&0xFF; 
VertLightY = ((int) (LightDir(l)*127.0f))&0xFF; 
VertLightZ = ((int) (LightDir(2)*127.0f))&0xFF; 

Since we are assuming that each vertex light vector is of unit 
length and because we are using * linear' interpolation, the 
vector for a particular pixel will have a length that is <1. 
As with the bump map, it is important that the in-between 
vectors are not too short or else too much accuracy will be 
lost . 

If we assume that the maximum sensible angle difference will 
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be 120*^ then the shortest vector will be sin(30'') = J^- We will 

therefore only lose about 1 bit of accuracy due to the 
shortening of vectors. 

To have the chance of 'smooth* animation, it is important that 
small changes in light direction can be modelled. This will 
be of maximum importance near where the light direction = 
(0,1,0) ie. on the horizon so examining the minimum integer 
variation that seems possible we get [2,254,0] . This appears 
to be about an angle of 0,1 degrees, which seems small enough. 

The shading "dot product" computation is much simpler than it 
is with polar coordinates and is implemented in a well known 
manner . 

To simulate glossy highlights, a 'power* function is usually 
applied to the dot product so that bright areas become 
concentrated. The typical Phong lighting model raises the dot 
product to an arbitrary power, but this is too expensive to 
implement in hardware . 

A cheaper, but more than satisfactory function is to use a 
quadratic approximation as shown below. 
Let X be the result of the dot product, 

C be a 'fixed point* 8 bit concentration value, where C=0 
(==0.0) gives a linear output, and C=255 (==1.0) gives maximum 
concentration . 

We compute . . , 
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• Ar = C + 8j (k is a 9 bit value with 3 bits of fraction) 

• L = M/1A'(0, 1 023 -(/:*(! 023 3)); L is a lO bit fractional value 

• Q = {L* L)::^\0 QisalO bit fractional value 

• P = L + C*(g-i:)»8; 

P is then the fixed point result of the power function. Note 
that Q<L and so the final calculation will require signed 
maths . 

In total, the highlight function will require 5 add/subtracts 
and 3 multiplies, although a couple of these are rather simple 
degenerate cases. 

Thus, it will be appreciated that preferred embodiments of the 
present invention provide a system which enables textured 
surfaces to be shaded much more efficiently than has been 
possible . 

What is claimed is: 
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20. (Amended) A method for shading a three 
dimensional textured computer graphic image comprising 
the steps of : 

providing data defining the three dimensional 
computer graphic image , the image comprisinQ a set of 
pixels ; 

providing a set of surface normal vectors 
corresponding to the texture data for the image whereinj_ 
the surface normal vectors are stored in a local 
coordinate syste m, and an individual surface normal 
vector from the set of surface normal vectors is assigned 
to each pixel ; 

providing data defining at least one light source 
and its direction illuminating the image wherein the 
light source is defined in the same local coordinate 
system; and 

for each pixel in the image, deriving a shading 
value to be applied to that pixel from the act of surface 
normal vcctora vector assigned to the pixel and the light 
source data . 

22. (Amended) A method according to Claim 20 in 
which the light source data ieare stored in polar 
coordinates . 

23. (Amended) A method according to Claim 20 in 
which the step of deriving a shading value to be applied 
to a pixel comprises deriving a colour value and a 
blending value fro m the surface normal vector assigned to 
the pixel and the light source data and combining this 
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colour value with existing colour data f rom f or that pixel 
in dependence on the blending value. 

24. (Amended) A method according to Claim 20 in 
which the surface normal vector — jr& vectors are stored in 
Cartesian coordinates . 

25. (Amended) A method according to Claim 24 in 
which the light source data i-sare stored in Cartesian 
coordinates . 

26. (Amended) A method according to Claim 24 in 
whichj_ for each surface normal vector, only two of the 
Cartesian coordinates are stored. 

29. (Amended) Apparatus for shading a three 
dimensional textured computer graphic image comprising: 

means for providing data defining the three 
dimensional computer graphic image , the data defining 
pixels that comprise the image ; 

means for providing a set of surface normal vectors 
corresponding to the texture data applied to the image 
wherein^ the surface normal vectors are stored in a local 
coordinate system; 

means for assigning each pixel an individual one of 

the surface normal vectors from the set of surface normal 
vectors ; 

means for providing data defining at least one light 
source and its direction illuminating the image wherein 
the direction of the light source is provided in the same 
local coordinate system; and 
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means for deriving a shading value to be applied to 
each pixel in the image from the act of surface normal 
vcctoro vector assigned to the pixel and the light source 
data . 

30. (Amended) Apparatus according to Claim 2 9 in 
which the surface normal s normal vectors are stored in 
polar coordinates . 

31. (Amended) Apparatus according to Claim 29 in 
which light source data areis- stored in polar 
coordinates . 

32. .(Amended) Apparatus according to Claim 29 in 
which the surface norma Is normal vectors are stored in 
Cartesian coordinates . 

33. (Amended) Apparatus according to Claim 29 in 
which the light source data -ir&are stored in Cartesian 
coordinates . 



34. (Amended) Apparatus according to Claim 32 in 
which^ for each surface normal vector, only two of the 
Cartesian coordinates are stored. 
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20. (Amended) A method for shading a three 
dimensional textured computer graphic image comprising 
the steps of : 

providing data defining the three dimensional 
computer graphic image, the image comprising a set of 
pixels ; 

providing a set of surface normal vectors 
corresponding to the texture data for the image wherein, 
the surface normal vectors are stored in a local 
coordinate system, and an individual surface normal 
vector from the set of surface normal vectors is assigned 
to each pixel; 

providing data defining at least one light source 
and its direction illuminating the image wherein the 
light source is defined in the same local coordinate 
system; and 

for each pixel in the image, deriving a shading 
value to be applied to that pixel from the surface normal 
vector assigned to the pixel and the light source data. 

21. A method according to Claim 20 in which the 
surface normal vectors are stored in polar coordinates. 

22. (Amended) A method according to Claim 20 in 
which the light source data are stored in polar 
coordinates . 

23. (Amended) A method according to Claim 20 in 
which the step of deriving a shading value to be applied 
to a pixel comprises deriving a colour value and a 
blending value from the surface normal vector assigned to 
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the pixel and the light source data and combining this 
colour value with existing colour data for that pixel in 
dependence on the blending value. 

24. (Amended) A method according to Claim 20 in 
which the surface normal vectors are stored in Cartesian 
coordinates . 

25. (Amended) A method according to Claim 24 in 
which the light source data are stored in Cartesian 
coordinates . 

26. (Amended) A method according to Claim 24 in 
which, for each surface normal vector, only two of the 
Cartesian coordinates are stored. 

27- A method according to Claim 20 comprising the 
step of applying a linear filter to the texture data at 
least once to map values to individual pixels. 

28. A method according to Claim 20 including the 
step of applying a glossiness parameter to a pixel . 

29. (Amended) Apparatus for shading a three 
dimensional textured computer graphic image comprising: 

means for providing data defining the three 
dimensional computer graphic image, the data defining 
pixels that comprise the image; 

means for providing a set of surface normal vectors 
corresponding to the texture data applied to the image 
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wherein, the surface normal vectors are stored in a local 
coordinate system ; 

means for assigning each pixel an individual one of 
the surface normal vectors from the set of surface normal 
vectors ; 

means for providing data defining at least one light 
source and its direction illuminating the image wherein 
the direction of the light source is provided in the same 
local coordinate system; and 

means for deriving a shading value to be applied to 
each pixel in the image from the surface normal vector 
assigned to the pixel and the light source data. 

30. (Amended) Apparatus according to Claim 2 9 in 
which the surface normal vectors are stored in polar 
coordinates . 

31. (Amended) Apparatus according to Claim 2 9 in 
which light source data are stored in polar coordinates. 

32. (Amended) Apparatus according to Claim 29 in 
which the surface normal vectors are stored in Cartesian 
coordinates . 

33- (Amended) Apparatus according to Claim 2 9 in 
which the light source data are stored in Cartesian 
coordinates . 

34. (Amended) Apparatus according to Claim 32 in 
which, for each surface normal vector, only two of the 
Cartesian coordinates are stored. 
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35. Apparatus according to Claim 29 comprising 
means for applying a linear filter at least once to the 
texture data to map values onto individual pixels. 

36. Apparatus according to Claim 2 9 in which said 
means for deriving a shading value to be applied to a 
pixel comprises means for deriving a colour value and a 
blending value from the light source data and means for 
combining the colour value with an existing colour value 
in dependence on the blending value . 

37. (New) A method of shading a three dimensional 
graphics textured image comprising the steps of : 

defining a basic computer image to be textured, the 
computer image comprising a set of pixels, wherein, in 
said step of defining a basic computer image, an existing 
color value for each pixel is determined; 

determining whether or not the basic computer image 
is to be subjected to supplemental shading; 

if the basic computer image is to be subjected to 
supplemental shading : 

for each pixel in the basic computer image, 

providing a surface normal vector, wherein the 

surface normal vectors are in a local coordinate 

system; 

providing data defining a light source and the 
direction from which the light source illuminates 
the basic computer image, wherein the data are in 
the same local coordinate system as the surface 
normal vectors; 
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based on the surface normal vector for a pixel 
and the data defining the light source and the 
direction from which the light source illuminates 
the basic computer image, generating an alpha value 
and a supplemental color value for the pixel; and 

blending the existing color value and the 
supplemental color value together as function of the 
alpha value to produce a final color value for the 
pixel ; and 

if the basic computer image is not to be subjected 
to supplemental shading, designating the existing color 
value as the final color value. 

38. (New) The method of shading a three dimensional 
graphics textured image of Claim 37, wherein: 

a store contains a plurality of bump maps, each said 
bump map comprising a set of surface normal vectors; the 
surface normal vectors of a bump map varying as a 
function of the location of the surface normal vectors on 
the bump map; 

if the basic computer image is to be subjected to 
supplemental shading, one of the bump maps in the store 
is retrieved and the bump map is mapped over the basic 
computer image; and 

said step of providing a surface normal vector for a 
pixel is performed by determining which of the bump 
mapped surface normal vectors is mapped over the pixel. 

39. (New) The method of shading a three dimensional 
graphics textured image of Claim 37, wherein said step of 
providing a surface normal vector for a pixel is 
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performed by retrieving the surface normal vector from a 
store wherein, in the store, the surface normal vector is 
stored in one from the following set of coordinate 
systems: polar coordinate system and Cartesian coordinate 
system. 



